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REAL PARTY IN INTEREST 

The real party in interest is Digimarc Corporation, by an assignment from the inventors 
recorded at Reel 012185, Frames 0036- 0038, on September 20, 2001. 

RELATED APPEALS AND INTERFERENCES 

There are no related appeals or interferences. 

STATUS OF CLAIMS 
Claims 9-14, 25-27 and 30-35 are pending in the present application. Each of these 
claims stand finally rejected. Please see the Office Action Summary in the final Office Action 
mailed January 1 1> 2005. (Claims 1-8, 15-24, 28 and 2!> have been previously canceled.) 

STATUS OF AMENDMENTS 

All earlier-filed amendments have U^en entered. 

SUMMARY OF CLAIMED SU&IECT MATTER 

The present invention relates generally to stcganography, which is the art of hiding 
information (e.g., plural binary bits) in some other object without leaving human-apparent 
evidence of the alteration. Please see page 2, paragraph 9 of the subject specification. 

One form of steganography is digital watermarking. Digital watermarking may be used to 
modify media content to- embed a message or machine-readable code into the content. The 
content may be modified such that the embedded code is imperceptible or nearly imperceptible to 
the user, yet may be detected through an automated detection process. Please see the 
specification at paragraph 10, spanning pages 2 and 3. 

One problem faced by image m;uiagement sysrems is how to efficiently manage an 
image's ancestry and related information. Normal image processing (e.g., scaling, cropping, 
rotating, clipping, resizing, cut-and-pasting image blocks, and/or marking, etc.) of an "original" 
image results in a ^derivative" image. In conventional systems, derivative images frequently 
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retain minimal, if any, related metadata. The metadata, such as that stored in header or footer 
files, is easily separable from derivative images. Separation results in a significant loss of 
information, particularly for a derivative image. One conventional solution manually records an 
image identifier as an image moves through an exploitation (or derivative) process. This manual 
recording process is labor intensive and cumbersome at best. Please see, e.g., page 8, paragraph 
32 of the subject specification. 

The present invention addresses this and other problems using steganographic and digital 
watennarking techniques. 

One aspect of the invention, as recited in claim % is a method for managing images. The 
images include a first image comprising a first identifier steganographically embedded therein 
(see, e.g., page 8, lines 1-2 of paragraph 33; see al^o Fig. 2, image 001 including watermark 
identifier ID-] ), The method includes retrieving a copy of ihe first image from an image 
database (see, e.g., page 8, lines 4-5 of paragraph 33; see also Fig. 2, image 001 and database 14); 
altering the copy of the first image to provide a second image (see, e.g., page 9, paragraph 35 and 
lines 1-3 of paragraph 36; see also Fig. 2 - image 001 and derivative 001); steganographically 
embedding a second identifier in the second image (see, e.g., page 9, lines 1-4 and 8-13 of 
paragraph 36); and providing the sleganographically embedded second image to the image 
database for storage (see, e.g., Fig. 2 7 database 14 and image 001 OD-1) and derivative 001 ; see 
also page 9, lines 3*5 of paragraph 35, and page 1 0, lines I -5 of paragraph 39), wherein the 
image database associates the second identifier with the first identifier so as to associate the first 
image and the second image (see, e.g., page 9, lines 3-5 of paragraph 35; see also Fig. 2, database 
14 and image family, see also page 1 0, linos 4-8 of paragraph 39). 

Another aspect of the invention, as recited in claim 35 is an apparatus. The apparatus 
(see, e.g., Fig. 2, database 14) includes electronic processing circuitry and memory (see, e.g., 
page 17, paragraph 59). The memory includes records stored therein, the records comprising a 
plurality of images, the plurality of images including a first image (see, e.g., Fig. 2, image 001) 
and a second image (see, e.g., Fig. 2, derivative 001). The first image includes a first identifier 
steganographically embedded therein (see, e.g.. Fig. 2, ID-1; see also page 8, lines 1-2 of 
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paragraph 33). And the second image includes a second identifier steganographically embedded 
therein (see, e.g., Fig. 2, ED-5; see also page 9, lines 1-3 ol* paragraph 35). The second image is 
derived from the first image (see, e.g., page % last 2 lines of paragraph 34). The second identifier 
is associated with the first identifier so thai ihe first image and the second image are associated 
with one another (see, e.g., Fig. 2 ? database 14 and image family; see also page 9, lines 3-5 of 
paragraph 35 and page 10, lines 4-8 of paragraph 39). 

Yet another aspect of the invention, as recited in claim 25, is a system. The system 
includes a first user terminal (see, e.g., Fig. 4, terminal 40; see also page 14, paragraph 49), a 
second user terminal (see, e.g., Fig. 4, terminal 44; see also page 14 5 paragraph 49) and a 
database (see, e.g., Fig. 4, database 46; see also page 1 4, paragraph 49), The first user terminal 
and the second user terminal are in communication (see, e.g., Fig. 4; see also line 3 of paragraph 
49, page 1 4), and the first user terminal and the second user terminal are each in communication 
with the database (see, e.g., Fig, 4). The system also includes a gatekeeper to regulate the flow of 
at least a first image between the first user terminal and the second user terminal (see, e.g., 
"sentry 1 * 42 shown in Fig, 4 and discussed, e.g., in paragraphs 4 c >-54; see also the flowcharts 
shown in Fig. 6). The first image comprises at least a firsi digital watermark including a first 
identifier (see, e.g., lines 1 1 -17 of paragraph 49 on page 14; see also lines 3-5 of paragraph 50, 
page 15; and see S20 in Fig. 6). The gatekeeper determines a security level associated with the 
first image (see, e.g., lines 3-8 of paragraph 50, page 15; see also Fig. 6, S20), compares the first 
image security level with a user security level (see. e.g., lines 8-1 0 of paragraph 50 on page 1 5; 
see also S22, Fig. 6), and allows access by the second user terminal to the first image based on a 
result of the comparison (sec, e.g., lines 10-12 of paragraph 50 on page 15; see also S24 aod S26 
in Fig. 6). The gatekeeper includes or communicates with a digital watermark decoder to decode 
the digital watermark to determine the firsi identifier (see, e.g., lines 3-5 of paragraph 50, page 
1 5; see also S20, Fig. 6), and to interrogate the database with the first identifier to retrieve the 
security level (see, e.g., lines 5-7 of paragraph 50, page 1 5 ). 

Still another aspect of the invention, as recited in claim 26, is a system. The system 
includes a first user terminal (see, e.g., Fig, 4, terminal 40; see also page 14, paragraph 49), a 
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second user terminal (see, e.g., Fig. 4, terminal 44; see also page 14, paragraph 49) and a 
database (see, e.g., Fig. 4, database 46; see also page 14, paragraph 49). The first user terminal 
and the second user terminal are in communication (see, e.g., Fig. 4; see also line 3 of paragraph 
49, page 14), and the first user terminal and the second user terminal are each in communication 
with the database (see, e.g., Fig. 4). The system also includes a gatekeeper to regulate the flow of 
at least a first image between the first user terminal and the second user terminal (see, e.g., 
"sentry 9 * 42 shown in Fig. 4 and discussed, e.g., in paragraphs 49-54; see also the flowcharts 
shown in Fig, 6). The first image includes aL least a first digital watermark including a first 
identifier (see t e.g., lines 1 1-17 of paragraph 49 on page 14; see also lines 3-5 of paragraph 50, 
page 15; and see S20 in Fig. 6). The gatekeeper determines a security level associated with the 
first image (see, e.g- 7 lines 3-8 of paragraph 50 9 page 15; see also Fig. 6, S20), compares the first 
image security level with a user security level (see, e.g., lines 8-10 of paragraph 50 on page 15; 
see also S22, Fig, 6), and allows access by the second user terminal to the first image based on a 
resuli of the comparison (see 7 e.g., lines 10-12 of paragraph 50 on page 15; see also S24 and S26 
in Fig. 6). The first image digital watermark includes security level data (see, e,g., lines 4-5 and 
7-8 of paragraph 50 s page 15), and wherein said gatekeeper comprises or communicates with a 
digital watermark decoder to decode the digital watermark to determine the security level data 
(sec, e.g., lines 3-5 and 7-8 of paragraph 50, page 15; see also S20, Fig. 6). 

GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 

1. Claims 9-14 and 35 stand finally rejected under 35 U.S.C. 102(e) as being anticipated by U.S. 
Patent No. 6 7 141, 753 (hereafter 6t the Zhao patent"). 

2. Claims 25-27 and 30-34 stand finally rejected under 35 U-S.C, 102(e) as being anticipated by 
U.S. Patent No. 6,233,684 (hereafter ; the Stefik patent"). 
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ARGUMENT 

Appellants respectfully request thai the finul rejection of the pending claims be reversed 
since the cited references fail lo teach or suggest all of the elements of the pending claims. 

Rejections under KSLC 102(e) over the Zhao Patent 

Claims 9-13 

Independent claim 9 reads as follows: 

P. A method for managing images y the images including a first image comprising a first 
identifier steganographically embedded therein, said method comprising: 

retrieving a copy of the first image from an image database; 

altering the copy of the first image to provide a second image; 

steganographically embedding a stcond identifier in the second image; and 

providing the steganographically embedded second image to the image database for 
storage, wherein the image database associates the second identifier with the first identifier so 
as to associate the firsr image and the second image. 

The Examiner argues that it "is clesu: that there is an association between the second 
image and the first image because the second image is changed from the first image and they 
short a common f ingerprint watermark (column 7*8 and 11)." Please see the final Office 
Action, page 1 1, lines 7-9 (emphasis added); please also see the final Office Aciion, page 3, lines 
16-lfc. 

But this argument misses the crux of claim 9. 

The first and second images of claim 9 have at least different identifiers embedded 
respectively therein. Claim 9 recites a firsi image comprising a first identifier steganographically 
embedded therein (e.g., a first watermark identifier). And a second identifier steganographically 
embedded (e.g., a second watermark identifier) in a second image. 

But this is not all. 

Appeal Brief- 09/858,336 -7- 
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The image database associates the second identifier wiih the first identifier so as to 
associate the lirst image and the second image. Please set- claim 9 V reproduced above. 

The mere fact that an image may include a common watermark (or even multiple 
wateimarks) does not imply that a database is associating first and second identifiers to help 
associate related first and second images. 

Moreover, the work storage 1 105 in ihe Zhao patem does not associate first and second 
steganographic (e,g., watermark) identifiers to help associate related first and second images. 
Rather, the work storage ] 05 seems to store multiple copies to help reduce a probability that a 
second encryption key will bs lost. Please see Col. 7, lines 33-35 of the Zhao patent 

We respectfully request that the final rejection of claim 9 be reversed. 

Claim 35 

Independent claim 35 reads as follows: 
35. An apparatus comprising: 
electronic processing circuitry; and 
memory, 

said memory comprising records swred therein^ the records comprising a plurality of 
images, the plurality of images including a jirst image and a second image, 

wherein the first image includes a first identifier sieganograpkicatfy embedded therein, 

and 

wherein the second image includes a second identifier sieganographically embedded 

therein, 

wherein the second image is derived from the first image, and 

wherein the second identifier is associated with the first identifier so that the first image 
and the second image are associated with one another. 


1 The work storage 105 is relied upon by the Examiner as teaching an image database. Please 
see the Office Action at page 3, lines 3-4. 
Appeal Brief - 09/858,336 -8- 
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The Examiner argues that it u is clear that there is an association between the second 
image and the first image because the second image is changed from the first image and they 
share a common fingerprint watermark (column 7-8 and 1 1)/' (Emphasis added). Please see 
the Office Action, page 3, lines 16-18. 

But this argument fails to consider the claim language. 

The first and second images of claim 35 have at least different identifiers embedded 
respectively therein. Claim 35 recites a first image comprising a fi rst identifier 
steganographically embedded therein (e.g. t a first watermark identifier). And a second identifier 
steganographically embedded (e.g., a second watennark identifier) in a second image. 

But this is not alL • 

The second identifier is associated with the first identifier so that the first image and the 
second image are associated with one anot her. 

The mere fact that an image may include a common watermark (or even multiple 
wateimarks) does not imply that a database is associating first and second identifiers to help 
associate first and second images. 

Moreover, the work storage 2 105 in the Zhao patent does not associate first and second 
stegaaographic (e.g., watermark) identifiers to help associate related first and second images. 
Rather storing multiple copies in the work storage 1 05 helps reduce a probability that a second 
encryption key will be lost Please see Col. 7, lines 33-35 of the Zhao patent. 

We respectfully request that the final rejection of claim 35 be reversed. 


2 The work storage 105 is relied upon by the Examiner as teaching an image database. Please 
see the Office Action at page 3, lines 3-4. 
Appeal Brief - 09/858,336 ~9- 
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Rejections under US. C. 102(e) over the Stefik Patent 

Claims 25. 27. 31 and 33 
Independent claim 25 reads as follows: 
25. A system comprising; 
a first user terminal; 
q second user terminal; 

a database, wherein the first user terminal and the second mer terminal are in 
communication, and the first user terminal and the second user terminal are each in 
communication with the database; and 

a gatekeeper to regulate the flow of tit least a first image between the first user terminal 
and the second user terminal, wherein the first image comprises at least a first digital watermark 
including a first Identifier, said gatekeeper to determine a security level associated with the first 
image, compare the first image security level with a user security level, and to allow access by 
the second user terminal to the first Image based on a result of the comparison, wherein said 
gatekeeper comprises or communicates with a digital watermark decoder to decode the digital 
watermark to determine the first identifier, and to interrogate the database with the first 
identifier to retrieve the security level 

Claim 25 recites a digital watermark decoder to decode a digital watermark to determine 
a firsl identifier. The first identifier is used 10 interrogate a database to retrieve a security level. 
The retrieved security level is used to determine whether to allow access by a second user 
terminal to a first image through comparison with a user security level. 

The Examiner argues that, data extracted from a watermark and used to identify who and 
where an unauthorized reproduction of digital work came from, meets this limitation. Please see 
page 8, lines 1-3, of the final Office Action. 

We respectfully disagree. The Examiner's position simply ignores the claimed feature of 
databiise interrogation with the first identifier to retrieve a security level. (The Examiner's 

Appeal Brief - 09/858,336 -10- 
PAGE 1 2/22 • RCVD AT 1 1/2/2005 6:29:39 PM [Eastern Standard TimeJ* SVR:USPT0-ff XRF-6/27 * DN1S:2738300 * CSID:+5034694777 * DURATION (mm-ss]:05^6 


NOV-02-2Q05 16=38 


FROM-DIGIMARC 


+5034694777 


T-209 P. 01 3/022 F-673 


SWS;lmp 11/2/05 P0^6 PATENT 

position does not even suggest that a security level is deiermined at all; but, rather, implies 
simple user identification, e.g., ;t who and where".) 

The Examiner further notes that a watermark is sent through a trust box where a printer 
server is allowed to print an image for a given security level. Please see page 8, lines 3-7, of the 
final Office Action (citing cols. 9 and 12-16 of the Stefik patent). 

Even if the Stefik patent does disclose this teaching (which we do not concede), there is 
still no discussion of how a decoded watermark identifier is used to interrogate a database to 
retrieve a security level, and how this retrieved security level is used to control access to a first 
image:. 

Moreover, we do not read the cited passages of the Stefik patent (i.e.* cols. 9 and 12-16) 
in this manner. 

Although the Examiner cites six (6) columns for these features 3 , we see reference to a 
trust box starting in col. 14, line 1 3. According to the Stefik patent watermark data is obtained 
from a digital certificate provided by a user and primer. See Col. 1 5, lines 8-1 1 . In other words, 
a digital certificate (common in encryption schemes) itself contains the watermark information. 
See the final Office Action at page 12, lines 16-17. A watermark f ont is then downloaded to a 
printer for use when printing a book. See Col. 1 5, lines 11-13. 

But these passages do not seem terribly helpful for the features at issue. That is, there is 
no discussion of decoding a digital watermark to determine a first identifier, which is used to 
interrogate a database to retrieve a security level. ITie retrieved security level is used to 
determine whether to allow access by a second user terminal to a first image through comparison 
with a user security level. 

At best the Col. 1 5 passage of the Stefik patent discusses providing a watermark font to a 
printer through a trust box. Please see, e.g.. Col. 15, lines 11-13. The printer will use the font 
when printing a book. 


3 To be clear, the features at issue include using a decoded watermark identifier to interrogate a 
database to retrieve a security level, and using this retrieved security level to help control access 
to a first image. 
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But, in this regard, please recall that claim 25 envisions handling an image that is already 
watennarked ("wherein the first image comprises at leas t a first digital watermark including a 
first identifier"). 

The cited passages in the Stefik patent seem concerned with delivering a font to 
watetmark a book when printing . 

We respectfully request that the final rejection of claim 25 be reversed. 

Claims 26. 30, 32 and 34 
Independent claim 26 reads as follows: 
26. A system comprising: 
a first user terminal; 
a second user terminal; 

a database, wherein the first user terminal and The second user terminal are in 
communication, and the first user terminal and the second user terminal are each in 
communication with the database; and 

a gatekeeper to regulate the flow of at least a first image between the first user terminal 
and the second user terminal, wherein the first image comprises at least a first digital watermark 
including a first identifier, said gatekeeper to determine a security level associated with the first 
image, compare the first image security level with a user security level, and to allow access by 
the second user terminal to the first image based on a result of the comparison, wherein said first 
image digital watermark includes security level data, and wherein said gatekeeper comprises or 
communicates with a digital watermark decoder to decode the digital watermark to determine 
the security level data 

The Examiner cites the Stefik patent at Col. 1 7 as teaching "different levels of encryption 
and 'scrambling'". Please see the Office Action at page 8, lines 13-15. 

This alleged teaching is applied against the claim feature of a first image digital 
watermark including security level <lata. (Or said another way, the digital watermark itself 
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carries security level data,) 

We have carefully studied Col. 17 of the Siefik patent - it is only 17 lines long. 

We read this CoL 17 passage as discussing encrypting or scrambling a document at 
diffei-ent stages in a server. 

What is missing, however, is any discussion of how this encryption or scrambling 
information is carried in a digital watermark. 

There may be a misunderstanding of the technology involved in claim 26, some confusion 
between encryption and digital watermsirldng. 

As discussed at page 2, paragraph 9, of the subject specification, digital watermarking is a 
form of steganography that encompasses a great variety of techniques by which plural bits of 
digital data are hidden in some other objecL without leaving human-apparent evidence of 
alteration. In paragraph 12 (page 3 of the specification) we teach that a watermark embedding 
component embeds a watermark pattern by altering data simiples of the media content. These 
changes might be through subtle alteration of pixel values or through alteration of DCT or 
waveJet coefficients, etc. After watermarking, the content appears generally unchanged, as the 
watermark is imperceptibly hidden in the content. 

With encryption, however, the content becomes illegible and incoherent to a human 
observer. 

The discussion of different levels of encryption or scrambling at Col. ] 7 of the Stefik 
patent does not leach or suggest that security level data is carried or included in a digital 
watermark. 

We respectfully request that the fiiud rejection of claim 25 be reversed. 

CONCLUSION AM* REQUEST FOR REVERSAL 

The cited references collectively fail to disclose ail of the limitations of the pending 
claims. (Other deficiencies of the art need not be lurther belabored at this time.) As such, the 
claims are patentable over the cited references. 
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Appellants respectfully request that the Board reverse the final rejection of the pending 

claims. 

Respectfully submitted, 


Date: November 2, 2005 

Customer No. 23735 

Telephone: 503-469-4685 B 
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Ileven W. Stewart 
ttegistration No. 45,133 
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CLAIMS APPENDIX 

1-8. (canceled). 

9. (previously presented): A method for managing images, the images including a first 
image comprising a first identifier stegiinographicallj' embedded therein, said method 
comprising: 

retrieving a copy of the first image from an image database; 

altering the copy of the first image to provide a second image; 

steganographically embedding a second identifier in the second image; and 

providing the steganographically embedded second image to the image database for 
storage, wherein the image database associates the second identifier with the first identifier so as 
to associate the first image and the second image. 

10. (previously presented): The method according to claim 9, further comprising 
removing the iirst identifier from the second image. 

1 1 . (previously presented): The method according to claim 9, further comprising altering 
the first identifier in the second image. 

12. (previously presented): The method according to claim 9, further comprising storing 
information related to the first image in the database. 
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13. (original): The method according to claim 12, wherein the related 
information comprises al least one of metadata, location, date, permission level, security access 
levels, analyst comments, notes, files, and past usage information. 

14. (original): The method according to claim 1 3 5 wherein the database comprises a 
plurality of databases. 

15-24. (canceled). 

25. (previously presented): A system comprising: 
a first user terminal; 
a second user terminal; 

a database, wherein the first user terminal and the second user terminal are in 
communication, and the first user termhial and the second user terminal are each in 
communication with the database; and 

a gatekeeper to regulate the flow of at least a first image between the first user terminal 
and the second user terminal, wherein the first image comprises at least a first digital watermark 
including a first identifier, said gatekeeper io determine a security level associated with the first 
image, compare the first image security level with a user security level, and to allow access by 
the second user terminal to the first image based on a resuh of The comparison, wherein said 
gatekeeper comprises or communicates with a digital wateimark decoder to decode the digital 
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watermark to determine the first identifier, and to interrogate the database with the first identifier 
to retrieve the security level. 

26. (previously presented): A system comprising: 
a first user terminal; 
a second user terminal; 

a database, wherein the first user terminal and the second user terminal are in 
communication, and the first user terminal and the second user terminal are each in 
communication with the database; and 

a gatekeeper to regulate the flow of at least a first image between the first user terminal 
and the second user terminal, wherein die first image comprises at least a first digital watermark 
including a first identifier, said gatekeeper to determine a .security level associated with the first 
image, compare the first image security level with a user security level, and to allow access by 
the second user terminal to the first image based on a result of the comparison, wherein said first 
image digital watermark includes security level data, and wherein said gatekeeper comprises or 
communicates with a digital watermark decoder to decode the digitid watermark to determine the 
security level data. 

27. (previously presented): The system according to claim 25, wherein 
the user security level comprises at least one of a security level for a user and a security level for 
a user terminal. 
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28-29. (canceled). 

30. (previously presented): The system according io claim 26, wherein the user security 
level comprises at least one of a security level for a user and a security level for a user terminal. 

3 1 . (previously presented): The system according io claim 25, wherein said gatekeeper 
records in the database a transmission of the first image from the first user terminal to the second 
user terminal. 

32. (previously presented): The system according to claim 26, wherein said gatekeeper 
records in the database a transmission of the first image from the first user terminal to the second 
user terminal. 

33. (previously presented): The system of claim 2,S, further comprising a 
communications server, wherein the first user terminal and the second user terminal are in 
communication via said communications server. 

34. (previously presented): The system of claim 26, further comprising a 
communications server, wherein the first user terminal and the second user terminal arc in 
communication via said communications server. 
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35. (previously presented): An apparatus comprising: 

electronic processing circuitry; and 

memory, 

said memory comprising records stored therein, the records comprising a plurality of 
images, the plurality of images including a first image and a second image, 

wherein the first image includes a first identifier steganographically embedded therein, 

and 

wherein the second image includes a second identifier stegaaographically embedded 

therein, 

wherein the second image is derived from the first image, and 

wherein the second identifier is associated with the first identifier so that the first image 
and the second image are associated with one another. 
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